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METHOD OF JUDGING BIT VALUE OF DIGITAL WATERMARK", the contents of 
10 which are incorporated 
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BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

15 The present invention relates to a digital watermark technique for digital data, 

particularly image data. 

2. Description of Related Art 

Recently, from the viewpoint of copyright protection f or digital data such as 
image data, etc., much attention is being paid to a digital watermark technique. The 
20 digital watermark technique is defined as a technique of embedding specific information 
into digital data according to a predetermined rule so that the specific information 
cannot be extracted from the digital data without using at least the predetermined rule. 
According to this technique, for example, information on a purchaser of image 
data, etc. is beforehand embedded in the image data itself according 



i 



to the predetermined rule in such a manner that the 
information is not visible, and when the image data are 
illegally copied, the embedded information is extracted 
according to the predetermined rule from the data thus 
5 illegally copied to specify a person (purchaser) who 
illegally copies the data. 

Fig. 18 is a diagram showing the principle of 
information embedding/extracting processing into/from image 
data on the basis of a conventional digital watermark 
10 technique. 

With respect to the information embedding processing, 

as shown in Fig. 18, when a bit b± (O^SiSin) of bits bi to b n 
constituting information to be embedded is equal to 1, the 
bright of each of pixel data located at predetermined 

15 positions 1 to m of the image data is increased by U, and 
when the bit bi is equal to zero, the brightness of each 
pixel data is reduced by U.. This processing is carried out 
on all the bits bi to b n while the embedding position is 
shifted, thereby embedding the digital watermark 

20 information in the image data. 

With respect to the processing of extracting the 
digital watermark information thus embedded, for the bit bi 
(O^i^n) of bits bi to b n constituting the information thus 
embedded, the brightness sum S of all the pixel data 

25 located at the predetermined positions 1 to m of the image 
data and the brightness sum R (Reference value) of all the 
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pixel data located adjacently to the predetermined 
positions 1 to m are detected. If S-R ^ T (here, T is 
varied in accordance with a demanded error rate, and it is 
set to satisfy T ^ U * (the number m of pixel data in which 
5 Di is embedded)), it is judged that b t is equal to 1. If S- 
R ^ -T, it is judged that b± is equal to zero. If -T < S-R 
< T, it is judged that no information is embedded in each 
of the pixel data located at the predetermined positions 1 
to m. This processing is carried out on all the bits b x to 
10 b n to extract the digital watermark information in the 
image data. 

The digital watermark technique is described in more 
detail in Kobayashi, et al . : Data Hiding Based on Neighbor 
Pixels Statistics, In Proc. of IPS J 56 th Annual Conference, 

15 1V-03, (1998). 

When a geometrical deformation such as scale - 
up/scale-down or rotation is applied to image data in which 
digital watermark information as described above is 
embedded, the embedding positions of the bit data 
20 constituting the digital watermark information (the 

positions on the X-Y coordinate used when the bit data are 
embedded) are also deformed. Therefore, the digital 
watermark information cannot be extracted. A technique to 
overcome the above problem is disclosed in USP 5.636.292. 
25 According to this technique, as shown in Fig. 19, a 

calibrating digital watermark for estimating what 
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geometrical deformation is applied to the image data, that 
is, what scale -up /scale -down or rotation processing is 
applied to the image data in addition to the digital 
watermark information such as copyright information or the 
5 like, is beforehand embedded in the image data concerned. 
When the digital watermark information is extracted, the 
calibrating digital watermark information is extracted from 
the image data, and the degree of the deformation is 
analyzed, thereby estimating the scale-up/scale-down degree 

10 or the rotational angle applied to the image data concerned. 
Subsequently, the image data concerned are returned to the 
original image data (the image data before the geometrical 
deformation is applied) by referring to the scale-up/scale- 
up rate or the rotational angle thus estimated. Thereafter, 

15 the pixel data located at a predetermined position and the 
adjacent pixel data are extracted, and the differential 
value (S-R) therebetween is compared with a predetermined 
threshold value to extract the digital watermark 
information. 

20 SUMMARY OF THE INVENTION 

However, in the conventional method using the 
calibrating digital watermark as described above, not only 
digital watermark information such as copyright information, 
etc. which are to be originally embedded, but also a 

25 calibrating digital watermark are embedded in image data. 
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and thus this method has a problem that a great effect is 
imposed on the image quality. 

Therefore, a first object of the present invention is 
to provide a digital watermark technique which can specify 

5 a digital watermark information embedding position from 
geometrically-deformed image data without using any 
calibrating digital watermark. 

Further, in the above conventional method of judging 
the bit value of the digital watermark information, for a 

10 bit bi (O^i^n) of bits bi to b n constituting digital 
watermark information, the brightness sum S of all the 
pixel data located at the predetermined positions 1 to m of 
the image data and the brightness sum R (Reference value) 
of all the pixel data located adjacently to the 

15 predetermined positions 1 to m are detected. If S-R 2^ T, 

it is judged that b t = 1 . If S-R ^ -T, it is judged that b ± 
= zero. If -T < S-R < T, it is judged that no information 
is embedded in each of the pixel data located at the 
predetermined positions 1 to m. 

20 Here, a predetermined value is usually used as the 

threshold value T. However, when the threshold value T is 
not optimized to the image data from which the digital 
watermark information is extracted, -T < S-R < T is 
established although the bit b t constituting the digital 
25 watermark information is embedded to predetermined 

positions 1 to m of the image data, and thus it may be 
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judged that no information is embedded in the predetermined 
positions 1 to m. That is, the extraction sensitivity of 
the bits constituting the digital watermark information is 
lowered . 

5 On the other hand, if the extraction sensitivity of 

the bits constituting the digital watermark information is 
increased by setting the threshold value T to a lower value 
in advance, for some image data from which the digital 
watermark information is extracted, the bit value judgment 

10 error of the bits constituting the digital watermark 

information extracted from the image data is increased, so 
that the bit value judgment precision is degraded. 
Therefore, the bit value of the digital watermark 
information extracted from the image data cannot be relied 

15 on. 

Therefore, a second object of the present invention 
is to provide a digital watermark technique which can grasp 
whether the bit value of digital watermark information 
extracted can be relied on even when the extraction 

20 sensitivity of the bits constituting the digital watermark 
information is increased. 

In order to attain the first object, according to a 
first aspect of the present invention, a method of 
extracting digital watermark information from image data 

25 which has the digital watermark information embedded 

therein by altering at least one pixel data located at a 
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predetermined position on a specific coordinate and is 
geometrically deformed, comprises an embedding position 
check step of executing the processing of extracting at 
least one pixel data at a predetermined position on the 
5 specific coordinate from the image data and comparing the 
data value thus extracted with a reference value to judge 
whether the information is embedded in the pixel data while 
applying the geometrical deformation on the image data 
until it is confirmed that the information is embedded in 

10 the pixel data. 

Here, the geometrical deformation means a reversible 
deformation such as scale-up/scale-down or rotation, that 
is, it means that deformed data can be restored to original 
image data before the deformation. Further, the reference 

15 value may be the data value of pixel data located in the 
vicinity of the extracted pixel data or the data value of 
the extracted pixel data which is interpolatively estimated 
by using at least two pixel data located in the vicinity of 
the extracted pixel data. Further, "until it is checked 

20 that the information is embedded in the pixel data" 

specifically means "until the image data which is subjected 
to the geometrical deformation so that the differential 
value (absolute value) between the data value of the 
extracted pixel data and the reference value is maximum is 

25 detected" . 

According to the first aspect of the present 
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invention, a series of processing of extracting from the 
image data the pixel data located at the embedding position 
specified by a specific coordinate and comparing the data 
value of the pixel data concerned with the reference value 
to judge whether the information is embedded in the pixel 
data concerned is executed while applying the geometrical 
deformation on the image data until it is checked that the 
information is embedded in the pixel data. For example, 
the image data is rotated at a rotational angle, and then, 
it is checked whether the information is embedded in the 
pixel data while further the image data concerned is scaled 
up/scaled down by a predetermined magnification. If it is 
not checked that the information is embedded in the pixel 
data, the image data is rotated at another rotational angle 
and then the same processing is carried out. This 
processing is repetitively executed until it is checked 
that the information is embedded in the pixel data. 

With the above operation, without the calibrating 
digital watermark, the position at which the digital 
watermark information is embedded can be specified from the 
geometrically-deformed image data. 

In the first aspect of the present invention, the 
embedding position check step may comprise the following 
roughly checking step and detailed checking step. In the 
roughly checking step, the processing of extracting from 
the image data at least one pixel data located at a 
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predetermined position on the specific coordinate and 
comparing the data value thus extracted with the reference 
value to judge whether the information is embedded in the 
pixel data concerned is carried out while the geometrical 
5 deformation is applied to the image data by every first 

geometrical deformation rate until it is confirmed that the 
information is embedded in the pixel data concerned. In 
the detailed checking step, the processing of extracting 
from the image data at least one pixel data located at a 

10 predetermined position on the specific coordinate and 

comparing the data value thus extracted with the reference 
value to judge whether the information is embedded in the 
pixel data concerned is carried out while the geometrical 
deformation is applied to the image data by every second 

15 geometrical deformation rate smaller than the first 

geometrical deformation rate within a predetermined range 
containing the geometrical deformation rate when it is 
checked in the roughly checking step that the information 
is embedded in the pixel data until it is confirmed that 

20 the information is embedded in the pixel data concerned. 

Further, in the first aspect of the present invention, 
when the digital watermark information is embedded in the 
image data by altering at least one pixel data located at a 
predetermined position on a specific coordinate for each of 

25 plural bit data constituting the digital watermark 

information, the embedding position check step may be 
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carried out on at least one bit data of the plural bit data, 
whereby the plural bit data are extracted from the image 
data which are subjected to the geometrical deformation 
when the pixel data having the bit data concerned embedded 
therein is confirmed. 

With the above operation, the check of the pixel data 
having the digital watermark information embedded therein 
can be more efficiently performed. 

In order to attain the first object, according to a 
second aspect of the present invention, a method of 
extracting digital watermark information from image data 
which has the digital watermark information embedded 
therein by altering at least one pixel data located at a 
predetermined position on a specific coordinate and is 
geometrically deformed, comprises an embedding position 
check step of executing the processing of extracting at 
least one pixel data located at a predetermined position on 
the specific coordinate and comparing the data value 
thereof with a reference value to judge whether the 
information is embedded in the pixel data concerned while 
varying the predetermined position on the image data by 
deforming the specific coordinate until it is confirmed 
that the information is embedded in the pixel data 
concerned . 

According to the second aspect of the present 
invention, a series of processing of extracting from the 



image data the pixel data located at the embedding position 
of the digital watermark information specified by the 
specific coordinate and then comparing the data value of 
the pixel data concerned with the reference value to judge 
5 whether the information is embedded in the pixel data 
concerned is executed while deforming the specific 
coordinate until it is confirmed that the information is 
embedded in the pixel data. For example, the specific 
coordinate is rotated at a rotational angle, and then, it 

10 is checked whether the information is embedded in the pixel 
data while scaled up/scaled down by a predetermined 
magnification. If the embedding of the information is not 
confirmed, the specific coordinate is rotated at another 
rotational angle, and then, the same processing is carried 

15 out. This processing is repetitively carried out until it 
is confirmed that the information is embedded in the pixel 
data. 

With the above operation, the digital watermark 
information can be extracted from the geometrically - 

20 deformed image data without using any calibrating digital 
watermark. Further, according to the second aspect of the 
present invention, the embedding position of the digital 
watermark information can be checked without applying any 
geometrical deformation on the image data itself, so that 

25 the memory capacity needed for the processing and the load 
of the processor can be reduced to be less than these of 
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the first aspect of the present invention. 

Further, in the second aspect of the present 
invention, the embedding position check step may comprise 
the following roughly checking step and detailed checking 
step. In the roughly checking step, the processing of 
extracting from the image data at least one pixel data 
located at a predetermined position on the specific 
coordinate and comparing the data value thus extracted with 
the reference value to judge whether the information is 
embedded in the pixel data concerned is carried out while 
the predetermined position on the image data is varied by 
deforming the specific coordinate by every first 
deformation rate until it is confirmed that the information 
is embedded in the pixel data concerned. In the detailed 
checking step, the processing of extracting from the image 
data at least one pixel data located at a predetermined 
position on the specific coordinate and comparing the data 
value thus extracted with the reference value to judge 
whether the information is embedded in the pixel data 
concerned is carried out while the predetermined position 
on the image data is varied by deforming the specific 
coordinate by every second deformation rate smaller than 
the first deformation rate within a predetermined range 
containing the deformation rate when it is confirmed in the 
roughly checking step that the information is embedded in 
the pixel data until it is confirmed that the information 
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is embedded in the pixel data concerned. 

The first and the second deformation rate is 
determined, in some cases, according to the embedding 
positions in the image data of the watermark information, 
5 namely, a pattern of the watermark. With some pattern, the 
embedded watermark information can be detected, even when 
the rate of the deformation given to the image data having 
the watermark embedded therein is not the same as the 
deformation rate of the image data or the deformation rate 

10 of the coordinate for detecting the embedded information 
from the image data. In such a case, even when the first 
and the second deformation rate is made larger, there may 
still be a high possibility that the embedded information 
is detected from the image data. Or, when the first 

15 deformation rate is made larger and the second deformation 
rate is made smaller, there may still be a high possibility 
that the embedded information is detected from the image 
data. 

Therefore, in the case where the alteration of the 
20 pixel data effected due to the embedding of the watermark 
information is made by a unit of a pixel block larger than 
1x1 and the roughly checking step is conducted such that 
one of the pixels of the pixel block is detected, the first 
deformation rate can be larger. 
25 Figs. 20 and 21 are schematic diagram showing the 

positional relationship between the positions in the image 
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data where pixel data are altered due to the embedded 
information and the detecting positions to detect pixel 
data concerned which are determined by the coordinate 
deformation for detection. The alteration of the pixel 
5 data due to the embedded information is made by a block 

unit of 2 x 2 at 24 positions with a pitch of 10 pixels. In 
Fig. 20, there is no deviation between the positions where 
the altered pixel data are located and the detecting 
positions to detect the altered pixel data. All the 24 

10 detecting positions overlap with the positions subjected to 
the alteration, respectively. In this case, the embedded 
information can be detected correctly. On the other hand, 
in Fig. 21, there is a deviation between the alteration 
positions in the image data and the detection positions for 

15 the image data. In total, there is a deviation of two 

pixels in the length of 240 pixels. Fig. 21 shows the case 
where the detection coordinate is scaled up by 
242/240=1.0083 with respect to the image data. When the 
deformation rate is increased to that scale, the embedded 

20 information cannot be detected at one of the 24 positions 
and detection failure is caused. To solve this problem, 
the scale or the deformation rate may be lowered to less 
than 1.0083. When the size of the pixel block subjected to 
the alteration is enlarged from 2 x 2 to 4 x 4 , the 

25 deformation rate may be as rough as 244/240=1.0167, still 
ensuring the detection of the embedded information. 



14 



More specifically, when the size of the pixel block 
is selected to be P x P and N positions are subjected to 
the alteration with a pitch of D pixels, the first 
deformation rate may be increased upto (DN+P) / (DN)=1+P/ (DN) , 
5 still ensuring the detection of the embedded information in 
the roughly checking step. 

Although the detection in terms of coordinate 
scaling-up/down is mentioned as an example in the above, 
the coordinate rotation or the scaling -up /down or rotation 
10 of the image data itself can also be employed. 

In the second aspect of the present invention, when 
the digital watermark information is embedded in the image 
data by altering at least one pixel data located at a 
predetermined position on a specific coordinate for each of 
15 plural bit data constituting the digital watermark 

information, the embedding position check step may be 
carried out on at least one bit data of the plural bit data, 
whereby the plural bit data are extracted by using the 
deformation -applied specific coordinate when the pixel data 
20 having the bit data concerned embedded therein is confirmed. 

With the above operation, the check of the embedding 
position of the digital watermark information can be more 
efficiently performed. 

Further, in the second aspect of the present 
25 invention, it may be adopted that when the digital 

watermark information is embedded in the image data by 
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altering at least one pixel data located at a predetermined 
position on a specific coordinate for each of plural bit 
data constituting the digital watermark information, the 
embedding position checking step is carried out on at least 
5 one bit data of the plural bit data, a geometrical 

deformation is applied to the image data at the geometrical 
deformation rate corresponding to the deformation rate 
applied to the specific coordinate when the pixel data 
having the bit data concerned embedded therein is confirmed, 

10 and the plural bit data are extracted from the 

geometrically-deformed image data by using the specific 
coordinate before the deformation in the embedding position 
checking step. 

Usually, when image data are scaled down, any pixel 

15 data is removed from the image data according to the scale- 
down rate of the image data to reduce the size of the image 
data. Therefore, when the scale-down processing is carried 
out on image data having digital watermark information 
embedded therein, pixel data having (a part of) the digital 

20 watermark information may be removed from the image data 
concerned in the scale-down processing. In such a case, 
the overall digital watermark information may not be 
efficiently extracted from the image data concerned. 

Therefore, as described above, the embedding position 

25 checking step is carried out on at least one bit data of 
plural bit data constituting the digital watermark 
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information to check the pixel data having the bit data 
concerned embedded therein. If the pixel data is confirmed, 
the image data are scaled up with the scale-up rate 
corresponding to the scale-down rate of the coordinate when 
5 the pixel data is confirmed, thereby returning the size of 
the image data to the original size (the size before the 
scale-down processing is carried out). Accordingly, pixel 
data which are lost due to the scale -down processing are 
restored and the plural bit data constituting the digital 

10 watermark information are extracted to thereby enhance the 
detection precision . 

In order to attain the second object, according to a 
third aspect of the present invention, a bit value judgment 
method of judging a bit value of digital watermark 

15 information embedded in image data in which the digital 

watermark information is embedded by altering at least one 
pixel data located at a predetermined position on a 
specific coordinate for each of plural bit data 
constituting the digital watermark information, comprises: 

20 an error rate calculation step of calculating, for each of 
at least two bit data of plural bit data constituting the 
digital watermark information, the differential value 
between pixel data in which the bit data concerned is to be 
embedded and a reference value, and determining, on the 

25 basis of a probability distribution curve settled by the 
distribution of the differential values thus calculated, a 
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bit value judgement error rate of the plural bit data when 
a threshold value used for the bit value judgment of the 
bit data is represented by T; and a bit value judgment step 
of comparing, for each of the plural bit data constituting 
the digital watermark information, the threshold value T 
and the differential value between pixel data in which the 
bit data concerned is to be embedded and the reference 
value when the judgment error rate calculated in the error 
rate calculation step is smaller than a predetermined value, 
thereby judging the bit value (0 or 1) of the bit data 
concerned . 

Here, the probability distribution curve settled by 
the distribution of the differential values may be 
calculated from a statistic value such as the average value 
or dispersion value of the differential values obtained for 
each of at least the two bit data of the plural bit data 
constituting the digital watermark information, or a 
histogram of the differential values. 

The bit value judgment error rate of the bit data 
concerned when the threshold value used for the bit value 
judgment of the bit data is represented by T may be 
calculated as the occupational rate of a part located 
within the range from -T to T to the overall probability 
distribution curve settled by the distribution of the 
differential values. 

According to the third aspect of the present 
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invention, prior to the bit value judgment of the digital 
watermark information embedded in the image data, the bit 
value judgment error rate of the digital watermark 
information embedded in the image data concerned when the 
threshold value used for the bit value judgment is 
represented by T is calculated, and only when the 
calculation result is smaller than a predetermined value , 
the bit value judgment of the digital watermark information 
embedded in the image data concerned is carried out by 
using the threshold value T. Therefore, even when the 
threshold value T used for the bit value judgment is set to 
a low value to increase the extraction sensitivity of the 
bits constituting the digital watermark information, the 
reliability of the bit value of the digital watermark 
information thus extracted can be ensured. 

Further, in order to attain the second object, 
according to a fourth aspect of the present invention, a 
bit value judgment method of judging a bit value of digital 
watermark information embedded in image data in which the 
digital watermark information is embedded by altering at 
least one pixel data located at a predetermined position on 
a specific coordinate for each of plural bit data 
constituting digital watermark information, comprises: an 
error rate calculation step of calculating, for each of at 
least two bit data of plural bit data constituting the 
digital watermark information, the differential value 
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between pixel data in which the bit data concerned is to be 
embedded and a reference value, and determining, on the 
basis of a probability distribution curve settled by the 
distribution of the differential values thus calculated, a 
5 bit value judgement error rate of the plural bit data when 
a threshold value used for the bit value judgment of the 
bit data is represented by T; a bit value judgement step of 
comparing, for each of the plural bit data constituting the 
digital watermark information, the threshold value T with 

10 the differential value between pixel data in which the bit 
data concerned is to be embedded and the reference value, 
thereby judging the bit value (0 or 1) of the bit data 
concerned; and an output step of output ting the bit values 
of the plural bit data constituting the digital watermark 

15 information judged in the bit value judgment step together 
with the bit value judgment error rate calculated in the 
error rate calculation step. 

According to the fourth aspect of the present 
invention, the bit value judgment result of the digital 

20 watermark information embedded in the image data is output 
together with the bit value judgment error rate for the 
threshold value T used for the bit value judgment of the 
digital watermark information embedded in the image data. 
Accordingly, when the threshold value T used for the bit 

25 value judgment is set to a low value to increase the 

extraction sensitivity of the bits constituting the digital 
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watermark information, it can be grasped how degree the 
reliability of the bit value of the digital watermark 
information thus extracted is. 

In the third and fourth aspects of the present 
invention, when the threshold value T is set to zero, in 
the bit value judgment of the digital watermark information, 
by checking, for each of the plural bit data constituting 
the digital watermark information, whether the differential 
value between pixel data in which the bit data concerned is 
to be embedded therein and the reference value is positive 
or negative, the bit value ( 0 or 1 ) of the bit data 
concerned is judged- That is, by setting the threshold 
value T for the bit value judgment to zero, the judgment of 
0 or 1 is necessarily made for each of the plural bit data 
constituting the digital watermark information embedded in 
the image data, thereby maximizing the extraction 
sensitivity of the bits constituting the digital watermark 
information . 

In this case, in the error judgment step, for each of 
at least two bit data of the plural bit data constituting 
the digital watermark information, the differential value 
between the pixel data in which the bit data concerned is 
to be embedded and the reference value is calculated, and 
at least two differential values thus calculated are 
classified into two subsets on the basis of the judgement 
as to whether the differential value is positive or 
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negative, and two probability distribution curves are 
determined on the basis of the distribution of the 
differential values contained in each of the two subsets. 
The bit value judgment error rate can be calculated by 
5 checking the rate of the negative part in the probability 
distribution curve of the positive subset and/or the rate 
of the positive part in the probability distribution curve 
of the negative subset . 

In order to attain the first and second objects, 

10 according to a fifth aspect of the present invention, the 
digital watermark extraction method of the first or second 
aspect of the present invention is combined with the bit 
value judgment method of the digital watermark information 
of the third or fourth aspect of the present invention. 

15 That is, the embedding position of each bit constituting 
the digital watermark information embedded in the image 
data is specified by the digital watermark extraction 
method of the first or second aspect, and the bit value 
judgment of the digital watermark information is carried 

20 out on the image data for which the embedding position of 
each bit constituting the digital watermark information as 
described above is specified, by the bit value judgment 
method of the digital watermark information of the third or 
fourth aspect of the present invention . 

25 Here, a device for executing the digital watermark 

extraction method of the first or second aspect and a 



22 



device for executing the bit value judgment method of the 
digital watermark information of the third or fourth aspect 
may be the same, or may be separate and independent devices. 

The error rate judgment step of the third to fifth 
aspects of the present invention may be applied to a case 
where it is merely judged whether watermark information is 
embedded in image data. That is, according to a sixth 
aspect of the present invention, a digital-watermark- 
information presence or absence judging method of judging 
whether digital watermark information is embedded in image 
data by altering at least one pixel data located at a 
predetermined position on a specific coordinate in the 
image data for each of plural bit data constituting the 
digital watermark information, comprises a step of 
calculating, for each of at least two bit data of plural 
bit data constituting the digital watermark information, 
the differential value between pixel data in which the bit 
data concerned is to be embedded and a reference value, and 
a step of judging it on the basis of a probability 
distribution curve settled by the distribution of the 
differential values thus calculated whether the digital 
watermark information is embedded. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a diagram showing the principle of 
extraction processing of extracting digital watermark 



information from image data according to a first embodiment 
of the present invention; 

Fig. 2 is a diagram showing the principle of the 
extraction processing of extracting the digital watermark 
5 information from the image data according to the first 
embodiment of the present invention; 

Fig. 3 is a functional diagram showing a digital 
watermark information extraction device to which the first 
embodiment of the present invention is applied; 
10 Fig. 4 is a diagram showing a hardware configuration 

of the digital watermark information extraction device 
shown in Fig. 3; 

Fig. 5 is a flowchart showing the operation of a 
xough size/position matching unit 504 according to the 
15 first embodiment of the present invention; 

Fig. 6 is a flowchart showing the operation of a 
detailed size/position matching unit 505 according to the 
first embodiment of the present invention; 

Fig. 7 is a diagram showing the principle of 
20 extraction processing of extracting digital watermark 
information from image data according to a second 
embodiment of the present invention; 

Fig. 8 is a diagram showing the principle of the 
extraction processing of extracting the digital watermark 
25 information from the image data according to the second 
embodiment of the present invention; 
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Fig. 9 is a flowchart showing the operation of the 
rough size/position matching unit 504 according to the 
second embodiment of the present invention; 

Fig- 10 is a flowchart showing the operation of the 
5 detailed size/position matching unit 504 according to the 
second embodiment of the present invention; 

Fig. 11 is a functional diagram showing a watermark 
detector 507 used in a third embodiment of the present 
invention; 

10 Fig. 12A is a diagram showing the probability 

distribution curve of differential value S-R in a case 
where digital watermark information is embedded, and Fig. 
12B is a diagram showing the probability distribution curve 
of differential value S-R in a case where digital watermark 

is information is not embedded; 

Fig. 13 is a flowchart showing the operation of the 
watermark detector 507 used in the third embodiment of the 
present invention; 

Fig. 14 is a flowchart showing a modification of the 

20 operation of the watermark detector 507 used in the third 
embodiment of the present invention; 

Fig. 15 is a diagram showing the probability 
distribution curve of the differential value S-R in a case 
where digital watermark information is embedded; 

25 Fig. 16 is a diagram showing a modification of the 

first to third embodiments in which the processing of 
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specifying the bit position value of the digital watermark 
information embedded in the image data and the processing 
of judging and extracting the bit value of each bit of the 
digital watermark information embedded in the image data 
5 are carried out by different devices ; 

Fig. 17 is a diagram showing a system when a program 
to build up a digital watermark information presence or 
absence judging device shown in Fig. 16 is supplied in a 
style which is so-called agent; 

io Fig. 18 is a diagram showing the principle of 

information embedding/extraction processing into/from image 
data based on a conventional digital watermark technique; 

Fig. 19 is a diagram showing a technique of 
specifying a geometrical deformation applied to image data 

15 by using a conventional calibrating digital watermark. 

Fig. 20 is a schematic diagram showing the case in 
which the positions in the image data where pixel data are 
altered due to embedding of the watermark information are 
not deviated from the detecting positions for detecting the 

20 pixel data concerned; and 

Fig. 21 is a similar schematic diagram showing the 
case in which the positions where the pixel data are 
altered due to the embedding of the watermark information 
are deviated from the detecting positions for detecting the 

25 pixel data concerned. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Preferred embodiments according to the present 
invention will be described hereunder with reference to the 
accompanying drawings . 

First, a first embodiment of the present invention 
will be described. 

In this embodiment , digital watermark information is 
embedded in image data by altering at least one pixel data 
located at a predetermined position on a specific X-Y 
coordinate, and the image data are subjected to a 
geometrical deformation. The processing of extracting at 
least one pixel data located at a predetermined position on 
the specific X-Y coordinate from the image data which are 
embedded with the digital watermark mark and geometrically 
deformed and then comparing the data value of the pixel 
data thus extracted with a reference value to judge whether 
information is embedded in the pixel data concerned is 
executed while the geometrically deformation is applied to 
the image data until it is confirmed that the information 
is embedded in the pixel data concerned. 

First, prior to the detailed description of a digital 
watermark information extraction device to which the first 
embodiment of the present invention is applied, the 
principle of digital watermark information extracting 
processing of this embodiment will be described. 

Figs . 1 and 2 are diagrams showing the principle of 



the processing of extracting the digital watermark 
information from the image data according to the first 
embodiment of the present invention. 

As shown in Fig. 18, it is assumed that each of bits 
bi to b n constituting the digital watermark information is 
embedded in the image data so that the brightness of pixel 
data located at each of predetermined positions 1 to m on a 
specific X-Y coordinate is increased by U if the 
corresponding bit is equal to 1 or reduced by U if the 
corresponding bit is equal to zero, and then the image data 
having the digital watermark information embedded therein 
are scaled up/scaled down by a predetermined magnification. 
In this case, in the image data thus scaled up/down, the 
positional correspondence between each predetermined 
position (1 to m) on the specific X-Y coordinate of each of 
the bits bi to b n and the position of each pixel data at 
which each of the bits bi to b n is actually embedded is 
displaced, so that it cannot be extracted. 

Therefore, as shown in Fig. 1, the size of the image 
data is scaled down to a predetermined size (for example, 
0.5 times), pixel data located at predetermined positions 1 
to m on the specific X-Y coordinate are extracted for each 
of bits of any number (for example, bits of 20 < n) of the 
bits bi to b n constituting the digital watermark information, 
the differential value (S-R) between the sum S of the 
brightness values thereof and the sum R of the brightness 
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values of the pixel data adjacent to the pixel data thus 
extracted is calculated, and then the differential value 
(S-R) is compared with a predetermined threshold value T to 
judge whether bit data are embedded in the pixel data thus 
5 extracted. If it is judged that no bit data are embedded 
in the pixel data extracted, the same processing is carried 
out while the scaled-down image data is enlarged every 
predetermined magnification rate (for example, every 1%). 
This processing is repeated until it is confirmed that the 

10 bit data are embedded. 

The magnification rate is determined, in some cases, 
according to the positions of the pixel data where the 
watermark is embedded or the pattern of the watermark. For 
example, when the deformation rate applied to the image 

15 data is different a little from the detecting deformation 
rate applied to the image data or the coordinate for 
detecting the embedded information, if the embedded 
information can be detected from the image data, the 
magnification rate may be increased, still ensuring the 

20 detection of the watermark information. 

If it is confirmed that the bit data are embedded 
(specifically, when image data having a size at which the 
absolute value of the differential value S-R is larger than 
the threshold value T and maximum are detected) , for each 

25 of the bits bi to b n constituting the digital watermark 
information, the pixel data located at the predetermined 
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positions 1 to m on the specific X-Y coordinate are 
extracted from the image having the size concerned, the 
differential value S-R between the sum S of the brightness 
values of the pixel data thus extracted and the sum R of 
5 the brightness values of pixel data adjacent to the 

respective pixel data thus extracted is calculated, and 
then the differential value S-R is compared with the 
threshold value T, thereby detecting the bit data embedded 
in the extracted pixel data. With this processing, the 

10 digital watermark information bi to b n embedded in the image 
data is detected. 

For example, when the image data having the digital 
watermark information embedded therein is scaled down by 
0.5 times, the digital watermark information can be 

15 detected by scaling up the image data concerned by two 
times as shown in Fig. 1. 

Further, it is assumed that the image data having the 
bits bi to b n constituting the digital watermark information 
embedded therein as shown in Fig. 18 are subsequently 

20 rotated at a predetermined angle. In this case, in the 
image data thus rotated, each of the predetermined 
positions 1 to m on the specific X-Y coordinate for the 
respective bits b x to b n is displaced from the position of 
the pixel data in which each of the bits bi to b n is 

25 actually embedded (that is, the positional correspondence 

between each of the predetermined positions (1 to m) of the 
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bits bi to b n and the position of the pixel data in which 
the corresponding bit is actually embedded is broken), so 
that the digital watermark information cannot be detected. 
Therefore, as shown in Fig, 2, the image data are 
5 rotated at a predetermined angle (for example, by -90 

degrees in a clockwise direction). Thereafter, for each of 
any number of bits (for example, bits of 20 < n) of the 
bits bi to b n constituting the digital watermark information, 
the pixel data located at the predetermined positions 1 to 

10 m on the specific X-Y coordinate are extracted, the 

differential value S-R between the sum S of the brightness 
values of the pixel data thus extracted and the sum R of 
the brightness values of the pixel data adjacent to the 
respective extracted pixel data is calculated, and the 

15 differential value thus calculated is compared with the 

threshold value T, thereby judging whether any bit data are 
embedded in the pixel data thus extracted- If it is judged 
that no bit data are embedded, the same processing is 
carried out while the image data thus rotated is further 

20 rotated by every predetermined angle (for example, every 

one degree in the clockwise direction) . This processing is 
repeated until it is confirmed that the bit data are 
embedded . 

The angle of rotation is determined, in some cases, 
25 according to the positions of the pixel data where the 

watermark is embedded or the pattern of the watermark. For 
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example, when the angle of rotation applied to the image 
data is different a little from the detecting angle of 
rotation applied to the image data or the coordinate for 
detecting the embedded information, if the embedded 
5 information can be detected from the image data, the angle 
of rotation may be enlarged, still ensuring the detection 
of the watermark information. 

If it is confirmed that the bit data are embedded in 
the pixel data, for each of the bits h x to b n constituting 

10 the digital watermark information, the pixel data located 
at the predetermined positions 1 to m on the specific X-Y 
coordinate are extracted from the image data at the 
rotational angle which is set at that time, the 
differential value S-R between the sum S of the brightness 

15 values of the pixel data thus extracted and the sum R of 
the brightness values of pixel data adjacent to the 
respective extracted pixel data is calculated, and then the 
differential value S-R is compared with the threshold value 
T, thereby detecting the bit data embedded in the pixel 

20 data thus extracted, whereby the digital watermark 

information bi to b n embedded in the image data is detected. 

For example, when the image data having the digital 
watermark information embedded therein are rotated at -45 
degrees in the clockwise direction, the digital watermark 

25 information can be detected by further rotating the rotated 
image data at 45 degrees in the clockwise direction as 
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shown in Fig, 2. 

In this embodiment , by executing both the processing 
shown in Figs, 1 and 2 in combination, the position of 
digital watermark information embedded in image data is 
5 enabled to be specified, even when the scale-up/scale-down 
or rotation processing is conducted on the image data 
having the digital watermark information embedded therein. 

Next, a digital watermark information extracting 
device for performing the above digital watermark 
10 information extraction processing will be described. 

Fig. 3 is a functional diagram showing the digital 
watermark information extraction device to which the first 
embodiment of the present invention is applied. 

As shown in Fig. 3, the digital watermark information 
15 extraction device of this embodiment comprises a processor 
501 and a storage unit 514. 

The processor 501 comprises an input/output unit 502 
serving to input /output image data having digital watermark 
information embedded therein and the digital watermark 
20 information extracted from the image data concerned, a 

controller 503 for collectively controlling each part of 
the digital watermark information extraction device, a 
rough size/position matching unit 504, a detailed 
size/position matching unit 505, an image restoring unit 
25 506, and a watermark detector 507. 

The storage unit 514 comprises an information- 
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inserted image holder 508 for holding image data, in which 
bits bi to b n constituting the digital watermark information 
are embedded, input through the input/output unit 502, a 
roughly incremental width holder 509, a rough threshold 
value holder 510, a detailed incremental width holder 511, 
a detailed threshold value holder 512 and a detection 
information holder 513. 

The rough size/position matching unit 504 determines 
rough size and rotational angle of the image data which are . 
requested to detect digital watermark information embedded 
in the image data held in the information- inserted image 
holder 508 . 

Specifically, first, the image data held in the 
information- inserted image holder 508 are scaled down by a 
predetermined magnification (for example, 0.5 times). For 
each of any number of bits (for example, bits of 20 < n) of 
the bits bi to b n constituting the digital watermark 
information, pixel data located at predetermined positions 
1 to m (it is assumed that these predetermined positions 
are beforehand notified by a person who embeds digital 
watermark information) on a specific X-Y coordinate (which 
is an X-Y coordinate used when the digital watermark 
information is embedded and known) are extracted, the 
differential value S-R between the sum S of the brightness 
values of the pixel data thus extracted and the sum R of 
the brightness values of pixel data adjacent to the 
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respective extracted pixel data is calculated, and then the 
differential value S-R thus calculated is compared with a 
first threshold value T x held in the rough threshold value 
holder 510 to judge whether bit data are embedded in the 
5 extracted pixel data concerned, A series of the above 

processing is carried out while rotating the image data by 
every first rotational angle (for example, every 3 degrees 
in the clockwise direction) held in the roughly incremental 
width holder 509 within a predetermined range (for example, 

10 in the range from 0 degree to 360 degrees). If it is 

judged that no bit data are embedded, the same processing 
is carried out while the image data are scaled up by every 
first magnification (for example, 3%) held in the rough 
incremental width holder 509. This processing is 

15 repetitively carried out until it is confirmed that the bit 
data are embedded (specifically, until the image data which 
is scaled up to a specific size and rotated by a specific 
rotational angle so that the absolute value of the 
differential value S-R is larger than the threshold value 

20 Ti and maximum is detected) . 

The magnification and the angular increment held in 
the rough incremental width holder 509 are determined, in 
some cases, by the positions of the pixel data where the 
watermark is embedded as mentioned above. More 

25 particularly, even if the deformation/rotation applied to 
the pixel data is different from the detecting 
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deformation/rotation applied to the image data or 
coordinate for detection of the embedded information, the 
magnification and the angular increment can be enlarged 
within a range the embedded information can be detected 
from the image data. 

The detailed size/position matching unit 505 
determines detailed size and rotational angle of the image 
data which are requested to detect the digital watermark 
information embedded in the image data held in the 
information- inserted image holder 508. 

Specifically, the image data held in the information- 
inserted image holder 508 are scaled down by a 
magnification which is lower by a predetermined 
magnification (for example, a) than the magnification A of 
the image data when it is confirmed that the bit data are 
embedded by the rough size/position matching unit 505. For 
each of any number of bits (for example, bits of 20 < n) of 
the bits bi to b n constituting the digital watermark 
information, the pixel data located at the predetermined 
positions 1 to m on the specific X-Y coordinate are 
extracted, the differential value S-R between the sum S of 
the brightness values of the pixel data and the sum R of 
the brightness values of the pixel data adjacent to the 
respective extracted pixel data is calculated, and then the 
differential value S-R is compared with the first threshold 
value Ti to judge whether the bit data are embedded in the 
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extracted pixel data. A series of the above processing is 
carried out while the image data are rotated by every 
second rotational angle (for example, one degree by one 
degree in the clockwise direction) smaller than the first 
5 rotational angle (the second rotational angle is held in 
the detailed incremental width holder 511) within a 
predetermined range (for example, in the range from B 
- (3 degree to B + (3 degree in the clockwise direction) 
containing the rotational angle B of the image data at the 

10 time when it is confirmed that the bit data are embedded in 
the pixel data by the rough size/position matching unit 505. 
If it is judged that no bit data are embedded, the same 
processing is executed while the image data are scaled up 
by every second magnification (for example, 1%) smaller 

15 than the first magnification, the second magnification 
being held in the detailed incremental width holder 511. 
This processing is repetitively carried out until it is 
confirmed that the bit data are embedded. 

The first rotational angle and magnification held in 

20 the rough incremental width holder 509, the second 

rotational angle and magnification held in the detailed 
incremental width holder 511 and the first threshold value 
Ti held in the rough threshold value holder 510 may be set 
through the input /output unit 502 by an operator. 

25 The magnification or rotation of rough increment is 

determined, in some cases, by the positions of the pixel 



data where the watermark is embedded or the pattern of the 
watermark as stated above. More particularly, even when 
the deformation/rotation applied to the pixel data is 
different from the detecting deformation/rotation applied 
to the image data or coordinate for detection of the 
embedded information, the magnification and the rotational 
angle can be enlarged within a range the embedded 
information can be detected from the image data. Or, it is 
also possible to enlarge the first magnification/rotational 
angle for the rough increment while reducing the second 
magnification/rotational angle . 

The image restoring unit 506 deforms the image data 
held in the information -inserted image holder 50 8 by the 
magnification and the rotational angle at the time when it 
is confirmed that the bit data are embedded by the detailed 
size/position matching unit 505, thereby restoring the 
original image data before the scale-up/scale-down or 
rotation is applied to the image data. 

For each of the bits bi to b n constituting the digital 
watermark information, the detector 507 extracts the pixel 
data located at the predetermined positions 1 to m on the 
specific X-Y coordinate from the image data restored in the 
image restoring unit 506, calculates the differential value 
S-R between the sum S of the brightness values of the 
extracted pixel data and the sum R of the brightness values 
of the pixel data adjacent to the extracted pixel data, and 
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compares the differential value S-R with a second threshold 
value T 2 whose absolute value is larger than the first 
threshold value T i# the second threshold value T 2 being held 
in the detailed threshold value holder 512, thereby judging 
5 the bit value of the bit data. More specifically, if S-R ^ 
T 2 , the bit concerned is judged as "1". If S-R ^ -T 2 , the 
bit concerned is judged as "0". If -T 2 < S-R < T 2 , it is 
judged that no bit is embedded in the extracted pixel data. 



10 extracted digital watermark information in the detection 

information holder 513. This information is output through 
the input /output unit 502, and submitted to the operator. 

Here, the relationship between the first threshold 
value Ti held in the rough threshold value holder 510 and 

15 the second threshold value T 2 held in the detailed 
threshold value holder 512 will be described. 

An error rate when all of digital watermark 
information bi to b 5 o of 50 bits embedded in image data are 
detected from the image data is represented by A, and an 

20 error rate when each bit constituting the digital watermark 
information bi to b 5 o are detected from the image data is 
represented by P. In this case, the following relational 
expression is established between A and P: 



Further, the watermark detector 507 holds the 



50 




25 



Assuming that the error rate A requested when all the 
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digital watermark information bi to b 50 of 50 bits are 
detected from in the image data are equal to 10" 6 , the error 
rate P of each bit must be set to be smaller than 10~ 8 . 

Accordingly, in order to detect all the digital 
watermark information b a to b 50 of 50 bits embedded in the 
image data at the error rate of 10~ 6 , it is necessary to 
detect each of the bits bi to b 50 at an error rate smaller 
than 10~ 8 . However, if in the rough size/position matching 
unit 504 and the detailed size/position matching unit 505, 
the first threshold value Ti is set so that the detection 
can be performed at an error rate of 10" 8 and it is judged 
whether bit data are embedded or not while varying the size 
and rotational angle of the image data, this needs much 
processing time. 

Therefore, according to this embodiment, in the rough 
size/position matching unit 504 and the detailed 
size/position matching unit 505, whether bit data are 
embedded or not is judged by using the first threshold 
value T x which is set so that bit data can be detected at 
an error rate (for example, about 10" 2 ) larger than the 
error rate of each bit which is originally requested when 
the size and rotational angle of the image data requested 
to detect the digital watermark information embedded in the 
image data is determined. After the size and rotational 
angle of the image data are determined, the bit value of 
each of the bits b x to b 50 constituting the digital 
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watermark information embedded in the image data is judged 
in the watermark detector 507 by using the second threshold 
value T 2 (whose absolute value is larger than the first 
threshold value Ti) which is set so that bit data can be 
detected at an originally requested error rate 1CT 8 of each 
bit. 

Assuming that the embedding position of the bit data 
could be confirmed if all of 20 bits out of the bits bi to 
b 50 constituting the digital watermark information can be 
detected at an error rate of about 10~ 2 , the probability 

_27 

that an error occurs in the above judgment is equal to 10 
and this means that there is no problem in practice. 

Next , the hardware construction of the digital 
watermark information extraction device to which this 
embodiment is applied will be described. Fig. 4 is a 
diagram showing a hardware construction of the digital 
watermark information extraction device shown in Fig. 3. 

As shown in Fig. 4, the digital watermark information 
extraction device of this embodiment can be built up on an 
information processing device having a general construction 
which includes a CPU 601, a memory 602, an external storage 
device 603 such as a hard disc device and another external 
storage device 604, an input device 605 such as a keyboard, 
an output device 606 such as a display or the like, and an 
interface 607 for the external storage devices and the 
input/output device. Here, each part of the processor 501 
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shown in Fig. 3 is implemented as a process embodied on the 
information processing device by executing a program loaded 
onto the memory 602 by the CPU 601. In this case, the 
memory 602 and the external storage devices 603, 604 are 
5 used as the storage unit 514 shown in Fig. 2. 

The program which is executed by the CPU 601 to 
embody the digital watermark information extraction device 
of this embodiment is beforehand stored in the external 
storage device 603, and it is loaded onto the memory 602 

10 and executed by the CPU 601 as occasion demands. Or, it is 
loaded through the external storage device 604 handling a 
portable storage medium 608, for example, CD-ROM, if 
necessary, from the portable storage medium 608 onto the 
memory 602 and then executed by the CPU 601. Alternatively, 

15 it is temporarily installed from the portable storage 

medium 608 through the external storage device 604 into the 
external storage device 603, and then it is loaded from the 
external storage device 603 onto the memory 602 and 
executed by the CPU 601. Or, it is loaded from a network 

20 to the external storage device 603 through a network 

connection device (not shown), then loaded onto the memory 
602 or directly loaded from the network onto the memory 602 
and then executed by the CPU 601. 

Next , the operation of the digital watermark 

25 information extraction device to which this embodiment is 
applied will be described. 
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First, the operation of the rough size/position 
matching unit 504 will be described. 

Fig. 5 is a flow chart showing the operation of the 
rough size/position matching unit 504 of this embodiment. 
5 In cooperation with the input/output unit 502, when the 
controller 503 controls the image data having the 
information of the bits bi to b n constituting the digital 
watermark information to be held in the information- 
inserted image holder 508, this flow is started. 

io First, the rough size/position matching unit 504 sets 

the magnification to an initial value (for example, 0.5 
times) (step S1001), and then sets the rotational angle to 
an initial value (for example, 0 degree) (step S1002). 
Subsequently, the rough size/position matching unit 504 

15 deforms the image data held in the information- inserted 
image holder 508 according to the magnification and the 
rotational angle thus set (step S1003) . 

Subsequently, the rough size/position matching unit 
504 extracts, for each of j bits (j < n) (for example, 20 

20 bits of bi to b 2 o) of the bits bi to b n constituting the 
digital watermark information, pixel data located at 
predetermined positions 1 to m (it is assumed that these 
positions are beforehand notified by a person who embeds 
digital watermark information, for example) on a specific 

25 X-Y coordinate (which is an X-Y coordinate used when the 
digital watermark information is embedded and known), 
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calculates the differential value S-R between the sum S of 
the brightness values of the extracted pixel data and the 
sum R of the brightness values of pixel data adjacent to 
the respective extracted pixel data and then comparing the 
5 differential value S-R with the first threshold value T x 
held in the rough threshold value holder 510 to judge 
whether bit data are embedded in the extracted pixel data 
(step S1004). More specifically, whether the bit data are 
embedded in the extracted pixel data concerned is judged by 
lo judging whether the absolute value of the differential 

value S-R is larger than the absolute value of the first 
threshold value Ti . When it is confirmed for all the bits 
of j that the bit data concerned are embedded in the 
extracted pixel data (step S1005), it is judged whether the 
15 peak value of the sum of the absolute values of the 

differential values S-R calculated for the respective j 
bits is detected(step S1006). Here/ the detection of the 
peak value is performed because it is considered that as 
each of the predetermined positions 1 to m on the specific 
20 X-Y coordinate for the bits bi to b n approaches to the 

position of the pixel data at which each of the bits bi to 
b n is actually embedded, the sum of the absolute values of 
the differential values S-R is increased. 

When the peak value is detected in step S1006, the 
25 magnification and the rotational angle set at the time when 
the peak value is detected are settled as the magnification 
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and the rotational angle for specifying the rough size and 
rotational angle of the image data, and the processing is 
finished. 

If it is not confirmed for all the j bits in step 
5 S1005 that the bit data concerned are embedded and if it is 
judged in step S1006 that any peak value has not yet been 
detected, the processing goes to step S1007. In step S1007, 
the rough size/position matching unit 504 judges whether 
the set rotational angle reaches the maximum value (for 

10 example, 360 degrees). If it does not reach the maximum 
value, the set rotational angle is incremented by only an 
incremental width (for example, 3 degrees) held in the 
rough incremental width holder 509 (step S1008), and the 
processing returns to step S1003. On the other hand, if it 

is reaches the maximum value, it is judged whether the set 

magnification reaches the maximum value (for example, two 
times) (step S1009). If it does not reach the maximum 
value, the set magnification is incremented by only an 
incremental width (for example, 3%) held in the rough 

20 incremental width holder 509 (step S1010), and the 
processing returns to step S1002. 

On the other hand, if the set magnification reaches 
the maximum value, it is confirmed that no digital 
watermark information is embedded in the image data, and 

25 the processing is finished. 

Next, the operation of the detailed size/position 
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matching unit 505 will be described. 

Fig. 6 is a flowchart showing the operation of the 
detailed size/position matching unit 505 according to this 
embodiment. This processing is started at the time when 
the rough size/position matching unit 504 determines the 
magnification and the rotational angle to specify the rough 
size and rotational angle of the image data through the 
processing flow of Fig. 5. 

First, the detailed size/position matching unit 505 sets 
the magnification to the rough magnification determined in 
the rough size/position matching unit 504 - ct(ct is set to 
the same magnification as the incremental magnification 
held in the rough incremental width holder 509, for 
example) (step S2001), and then sets the rotational angle 
to the rough rotational angle determined in the rough 
size/position matching unit 504 - (3 (p is set to the same 
rotational angle as the incremental rotational angle held 
in the rough incremental holder 509, for example) (step 
S2002). Next, the detailed size/position matching unit 505 
deforms the image data held in the information- inserted 
image holder 508 according to the magnification and the 
rotational angle thus set (step S2003). 

Subsequently, the detailed size/position matching 
unit 505 extracts, for each of bits of k (< n) (for example 
20 bits of b 2 i to b 40 ) out of the bits b x to b n constituting 
the digital watermark information, the pixel data located 



at the predetermined positions 1 to m on the X-Y coordinate 
used when the digital watermark information is embedded, 
calculates the differential value between the sum S of the 
brightness values of the pixel data and the sum R of the 
brightness values of pixel data adjacent to the extracted 
pixel data and then comparing the differential value S-R 
thus calculated with the first threshold value T x held in 
the rough threshold value holder 510, thereby judging 
whether bit data are embedded in the extracted pixel data 
(step S2004). If it is confirmed for all the bits of k 
that the bit data concerned are embedded in the extracted 
pixel data (step S2005), it is judged that the peak value 
of the sum of the absolute values of the differential 
values S-R calculated for the respective bits of k is 
detected (step S2006). If the peak value is detected, the 
magnification and the rotational angle set at the time when 
the peak value is detected are determined as the 
magnification and the rotational angle to specify the 
detailed size and rotational angle, and then the processing 
is finished. 

If, in step S2005, it is not confirmed for all the 
bits of k that the bit data concerned are embedded in the 
extracted pixel data, and if it is judged in step S2006 
that any peak value has not yet been detected, the 
processing goes to step S2007. Therefore, the detailed 
size/position matching unit 505 judges whether the set 




rotational angle reaches the rough rotational angle 
determined in the rough size/position matching unit 504 + p. 

If it does not reach the rough rotational angle + p, 
the set rotational angle is incremented by only an 
incremental width (for example, 1 degree) which is held in 
the detailed incremental width holder 511 and is smaller 
than the incremental width held in the rough incremental 
width holder 509 (step S2008), and then the processing 
returns to step S2003. 

On the other hand, if it reaches the rough rotational 
angle +(3, it is judged whether the set magnification 
reaches the rough magnification determined in the rough 
size/position matching unit 504 + a (step S2009). If it 
does not reach the rough magnification + a, the set 
magnification is incremented by only an incremental width 
(for example, 1%) which is held in the detailed rough 
incremental width holder 511 and is smaller than the 
incremental width held in the rough incremental width 
holder 509 (step S2010), and then the processing returns to 
step S2002. 

On the other hand, if the set magnification reaches 
to the rough magnification + a, it is confirmed that no 
digital watermark information is embedded in the pixel data, 
and the processing is finished. 

If the magnification and rotational angle to specify 
the detailed size and rotational angle of the image data 
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are determined through the processing flow of Fig. 6 in the 
detailed size/position matching unit 505 , the image 
restoring unit 506 deforms the image data held in the _ 
information-inserted image holder 508 on the basis of the 
5 magnification and the rotational angle thus determined to 
restore the image data before the geometrical deformation 
is applied thereto. 

The watermark detector 507 is supplied with the image 
data thus restored, and, for each of the bits bi to b n 

10 constituting the digital watermark information, extracts 

the pixel data located at the predetermined positions 1 to 
m on the X-Y coordinate used in the embedding process of 
the digital watermark information, from the image data thus 
restored, calculating the differential value S-R between 

15 the sum S of the brightness values thereof and the sum R of 
the brightness values of pixel data adjacent to the 
extracted pixel data and then comparing the differential 
value S-R thus calculated with the second threshold value 
T 2 which is held in the detailed threshold value holder 512 

20 and whose absolute value is larger than the first threshold 
value Ti, thereby judging the bit value of the bit data. 
More specifically, if S-R ^ T 2 , the bit concerned is judged 
as "1", if S-R ^ T 2 , the bit concerned is judged as "0", 
and if -T 2 < S-R <T 2 , it is judged that no bit is embedded 

25 in the extracted pixel data. 

The watermark detector 507 holds the digital 
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watermark information thus extracted into the detection 
information holder 513. This information is output through 
the input /output unit 502 and given to the operator. 

According to the above -described first embodiment of 
5 the present invention, the embedding position of the 

digital watermark information can be specified from the 
geometrically- deformed image data without using any 
calibrating digital watermark. In the above first 
embodiment, the magnification and the rotational angle to 

10 specify the rough size and rotational angle of the image 
data which are requested to detect the digital watermark 
information embedded in the image data are determined in 
the rough size/position matching unit 504, and then the 
magnification and rotational angle to specify the detailed 

15 size and rotational angle of the image data which are 

requested to detect the digital watermark information are 
determined on the basis of the determined rough 
magnification and rotational angle in the detailed 
size/position matching unit 505. With the above operation, 

20 the check of the pixel data in which the digital watermark 
information is embedded can be more efficiently performed. 

Further, according to the first embodiment, in the 
rough size/position matching unit 504 and the detailed 
size/position matching unit 505, the absolute value of the 

25 first threshold value Ti used to judge whether bit data are 
embedded in extracted pixel data is set to be smaller than 
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that of the second threshold value T 2 used to judge the 
data value of the bit data embedded in the extracted pixel 
data in the watermark detector 507, thereby more moderating 
the precision at the size/position matching stage of the 
5 image data as compared with the precision at the judgment 
stage of the digital watermark information. Accordingly, 
the check of the pixel data having the digital watermark 
information embedded thereof can be more efficiently and 
quickly performed. 

10 Next, a second embodiment of the present invention 

will be described. 

Unlike the first embodiment, according to the second 
embodiment, the processing of extracting at least one pixel 
data located at the predetermined position on the specific 

15 coordinate X-Y coordinate from image data in which digital 
watermark information is embedded by altering at least one 
pixel data located at a predetermined position on a 
specific coordinate X-Y coordinate and to which any 
geometrical deformation is applied, and then comparing the 

20 data value of the pixel data thus extracted with a 

reference value to judge whether information is embedded in 
the pixel data concerned is executed with leaving the image 
data itself as it is while deforming the specific X-Y 
coordinate itself until it is confirmed that the 

25 information is embedded in the pixel data concerned. 

First, prior to the detailed description of a digital 
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watermark information extracting device to which the second 
embodiment is applied, the principle of the digital 
watermark extracting processing of this embodiment will be 
described. 

5 Figs . 7 and 8 are diagrams showing the principle of 

the processing of extracting digital watermark information 
from image data according to the second embodiment of the 
present invention . 

As shown in Fig. 18, it is assumed that each of the 

10 bits bi to b n constituting digital watermark information is 
embedded in image data so that the brightness of each of 
pixel data located at predetermined positions 1 to m on a 
specific X-Y coordinate is altered so as to be increased by 
U if the bit concerned is equal to 1, and so as to be 

15 reduced by U if the bit concerned is equal to zero. 

Further, it is also assumed that the image data having the 
digital watermark information embedded therein is 
subsequently scaled up/down by a predetermined 
magnification. In this case, in the scaled-up/down image 

20 data, the positional correspondence between the 

predetermined positions 1 to m on the specific coordinate 
for each of the bits b x to b n and the position of pixel data 
at which each of the bits bi to b n is actually embedded is 
broken (i.e., these positions are positionally displaced 

25 from each other) , and thus the digital watermark 
information cannot be extracted. 
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Therefore, as shown in Fig. 7, the specific X-Y 
coordinate (the coordinate used when the digital watermark 
information is embedded in the image data) is scaled down 
to a predetermined size (for example, by 0.5 times). 
Thereafter, for each of any number of bits (for example, 
bits of 20 (< n)) of the bits bi to b n constituting the 
digital watermark information, the pixel data located at 
the predetermined positions on the scaled-down X-Y 
coordinate are extracted, the differential value S-R 
between the sum S of the brightness values of the pixel 
data thus extracted and the sum R of the brightness values 
of the pixel data adjacent to the extracted pixel data is 
calculated and then the differential value S-R is compared 
with a predetermined threshold value T, thereby judging 
whether the bit data are embedded in the extracted pixel 
data. 

The magnification may, in some cases, be determined 
by the positions of the pixel data where the watermark is 
embedded or the pattern of the watermark as stated above. 
More particularly, even when the deformation rate applied 
to the pixel data is different from the detecting 
deformation rate applied for detection of the embedded 
information, the magnification can be enlarged within a 
range the embedded watermark information can be detected 
from the image data. If it is judged that no bit data are 
embedded, the same processing is carried out while the X-Y 
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coordinate is scaled up by every predetermined 
magnification (for example, 1% by 1%). This processing is 
repetitively carried out until it is confirmed that the bit 
data are embedded. If it is confirmed that the bit data 
5 are embedded (specifically, the X-Y coordinate having the 
size which provide the absolute value of the differential 
value S-R which is larger than the threshold value T and 
maximum is detected) , for each of the bits bi to b n 
constituting the digital watermark information, on the 

10 basis of the X-Y coordinate of the magnification at that 
time, pixel data located at the predetermined positions 1 
to m are extracted, the sum S of the brightness values of 
the pixel data thus extracted and the sum R of the 
brightness values of the pixel data adjacent to the 

15 extracted pixel data is calculated, and then the 

differential value S-R is compared with a predetermined 
threshold value T to detect the bit data embedded in the 
pixel data thus extracted, whereby the digital watermark 
information bi to b n embedded in the image data is detected. 

20 For example, when image data having digital watermark 

information embedded therein is scaled up by two times, 
the X-Y coordinate used when the digital watermark 
information is embedded in the image data is scaled up by 
two times, whereby the digital watermark information can be 

25 detected as shown in Fig. 7. 

It is assumed that the image data having the bits bi 
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to b n constituting the digital watermark information 
embedded therein as shown in Fig. 18 is subsequently 
rotated at a predetermined angle. In this case, in the 
image data thus rotated, each of the predetermined 
5 positions 1 to m on the specific X-Y coordinate for each of 
the bits b x to b n is displaced from the position of pixel 
data at which each of the bits b x to b n is actually embedded, 
so that the digital watermark information cannot be 
extracted. 

10 Therefore, as shown in Fig. 8, the specific X-Y 

coordinate is rotated at a predetermined angle (for example, 
by -90 degrees in the clockwise direction). Thereafter, 
for each of any number of bits (for example, 20 bits (< n)) 
of the bits b x to b n constituting the digital watermark 

15 information, the pixel data located at the predetermined 
positions 1 to m on the X-Y coordinate thus rotated are 
extracted, the differential value S-R between the sum S of 
the brightness values of the extracted pixel data and the 
sum R of the brightness values of pixel data adjacent to 

20 the extracted pixel data is calculated, and then the 

differential value S-R thus calculated is compared with a 
predetermined threshold value T, thereby judging whether 
bit data are embedded in the extracted pixel data. 

The rotational angle may, in some cases, be 

25 determined by the positions of the pixel data where the 
watermark is embedded or the pattern of the watermark as 
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stated above. More particularly, even when the angle of 
rotation applied to the pixel data is different from the 
detecting angle of rotation applied for detection of the 
embedded information, the rotational angle can be enlarged 

5 within a range the embedded watermark: information can be 
detected from the image data. If it is judged that no bit 
data are embedded, the same processing is carried out while 
the X-Y coordinate is further rotated by every 
predetermined angle (for example, by one degree in the 

10 clockwise direction) . This processing is repetitively 
carried out until it is confirmed that the bit data are 
embedded in the pixel data. If it is confirmed that the 
bit data are embedded, for each of the bits bi to b n 
constituting the digital watermark information, on the 

is basis of the X-Y coordinate having the rotational angle at 
that time, pixel data located at predetermined positions 1 
to m are extracted, the differential value S-R between the 
sum S of the brightness values of the extracted pixel data 
and the sum R of the brightness values of the pixel data 

20 adjacent to the extracted pixel data is calculated, and 
then the differential value S-R is compared with a 
threshold value T to detect the bit data embedded in the 
extracted pixel data, whereby the digital watermark 
information bi to b n embedded in the image data is detected. 

25 For example, when the image data having the digital 

watermark information embedded therein are rotated by 45 



56 



. o . • • • ) ■ 

degrees in the clockwise direction, the X-Y coordinate used 
in the process of embedding the digital watermark 
information into the image data is rotated at 45 degrees in 
the clockwise direction as shown in Fig. 8, whereby the 
5 digital watermark information can be detected. 

In this embodiment , by executing the processing shown 
in Fig. 7 and the processing shown in Fig. 8 in combination, 
the position of digital watermark information embedded in 
image data can be specified even when the image data having 

10 the digital watermark information embedded therein are 

subjected to the scale-up/scale-down or rotating processing. 

Next , a digital watermark information extracting 
device for executing the above digital watermark 
information extracting processing will be described. The 

15 functional configuration of the digital watermark 

information extracting device to which this embodiment is 
applied is different from that of the first embodiment in 
the operations of the rough size/position matching unit 504 
and the detailed size/position matching unit 505. The 

20 hardware configuration of the second embodiment is the same 
as shown in Fig. 4. Therefore, the description of the 
functional configuration and hardware configuration of the 
digital watermark information extracting device are omitted, 
and only the operation thereof will be described. 

25 First, the operation of the rough size/position 

matching unit 504 of this embodiment will be described. 
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Fig. 9 is a flowchart showing the operation of the 
rough size/position matching unit 504 of this embodiment. 
This flow is started when the controller 503 holds image 
data having information of bits bi to b n constituting 
5 digital watermark information embedded therein into the 
information-inserted image holder 508 in cooperation with 
the input/output unit 502. 

First, the rough size/position matching unit 504 sets 
the magnification to an initial value (for example, 0.5 

10 times) (step S3001), and then sets the rotational angle to 
an initial value (for example, 0 degree) (step S3002). 
Subsequently, the rough size/position matching unit 504 
deforms a specific X-Y coordinate (which is used when the 
digital watermark information is embedded and is known) 

15 according to the magnification and the rotational angle 
thus set (step S3003). 

For each of bits of j (for example, 20 bits of b L to 
b 2 o) of the bits bi to b n constituting the digital watermark 
information, the rough size/position matching unit 504 

20 extracts the pixel data located at the predetermined 
positions 1 to m on the deformed X-Y coordinate (it is 
assumed that the predetermined positions are beforehand 
notified by a person who embeds the digital watermark 
information, for example), calculates the differential 

25 value S-R between the sum S of the brightness values of the 
extracted pixel data and the sum R of the brightness values 



58 



,n.- • • o 

of pixel data adjacent to the extracted pixel data, and 
then compares the differential value S-R with the first 
threshold value Ti held in the rough threshold value holder 
510, thereby judging whether bit data are embedded in the 
5 extracted pixel data (step S3004). If it is confirmed for 
all the bits of j that the bit data concerned are embedded 
in the extracted pixel data ( step S3005 ) , it is judged 
whether the peak value of the sum of the absolute values of 
the differential values S-R calculated for the respective 

10 bits of j is detected or not (step S3006). 

If the peak value is detected in the step S3006, the 
magnification and the rotational angle set at the time when 
the peak value is detected is determined as the 
magnification and the rotational angle to specify the rough 

15 size and rotational angle of the X-Y coordinate used to 
extract the pixel data having the digital watermark 
information b x to b n from the image data, and then the 
processing is finished. 

If it is not confirmed for all the bits of j in the 

20 step S3005 that the bit data concerned are embedded in the 
extracted pixel data, and if it is judged in step S3006 
that any peak value has not yet been detected, the 
processing goes to step S3007. In step S3007, the rough 
size/position matching unit 504 judges whether the set 

25 rotational angle reaches the maximum value (for example, 
360 degrees). If it does not reach the maximum value, the 
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set rotational angle is increased by only an incremental 
width (for example, 3 degrees) held in the rough 
incremental width holder 509 (step S3008), and then the 
processing returns to step S3003. On the other hand, if it 
5 reaches the maximum value, it is judged the set 

magnification reaches the maximum value (for example, two 
times) (step S3009). If it does not reach the maximum 
value, the set magnification is increased by only an 
incremental width (for example, 3%) held in the rough 

10 incremental width holder 509 (step S3010), and then the 
processing returns to step S3003. 

The magnification and the rotational angle held by 
the rough incremental width holder 509 may, in some cases, 
be determined by the positions of the pixel data where the 

15 watermark is embedded or the watermark pattern as stated 
above. More particularly, even when the positions of the 
deformation made in the pixel data are deviated from the 
detecting positions of the pixel data for detection of the 
embedded information, the magnification and the rotational 

20 angle can be enlarged within a range the embedded watermark 
information can be detected from the image data. 

On the other hand, if the set magnification reaches 
the maximum value, it is judged that any digital watermark 
information is not embedded in the image data, and the 

25 processing is finished. 

Next, the operation of the detailed size/position 
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matching unit 505 of this embodiment will be described. 

Fig. 10 is a flowchart showing the operation of the 
detailed size/position matching unit 505 of this embodiment. 
This flow is started at the time when the rough 
5 size/position matching unit 504 determines the 

magnification and the rotational angle to specify the rough 
size and rotational angle of the X-Y coordinate through the 
flow of Fig. 9. 

First, the detailed size/position matching unit 505 

lo sets the magnification to the rough magnification 

determined in the rough size/position matching unit 504 
- a (a is assumed to be the same as the incremental 
magnification held in the rough incremental rough width 
holder 509) (step S4001), and then sets the rotational 

15 angle to the rough rotational angle determined in the rough 
size/position matching unit 504 - (3 (p is assumed to be the 
same as the incremental rotational angle held in the rough 
incremental width holder 509, for example) (step S4002). 
Subsequently, the detailed size/position matching unit 505 

20 deforms the X-Y coordinate used in the process of embedding 
the digital watermark information according to the 
magnification and the rotational angle thus set (step 
S4003) . 

Subsequently, for each of bits of k (for example, 20 
25 bits of b 2 i to b 40 ) of the bits bi to b n constituting the 

digital watermark information, the detailed size/position 
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matching unit 505 extracts pixel data located at 
predetermined positions 1 to m on the deformed X-Y 
coordinate, the differential value S-R between the sum S of 
the brightness values of the extracted pixel data and the 
5 sum R of the brightness values of pixel data adjacent to 
the extracted pixel data is calculated, and then the 
differential value S-R thus calculated is compared with the 
first threshold value Ti held in the rough threshold value 
holder 510 , thereby judging whether bit data are embedded 

10 in the extracted pixel data (step S4004). If it is 

confirmed for all the bits of k that the bit data are 
embedded in the extracted pixel data (step S4005), it is 
judged whether the peak value of the sum of the absolute 
values of the differential values S-R calculated for the 

15 respective bits of k is detected (step S4006). If the peak 
value is detected, the magnification and the rotational 
angle set at the time when the peak value is detected are 
settled as the magnification and the rotational angle to 
specify the detailed size and rotational angle of the X-Y 

20 coordinate used when the pixel data having the digital 
watermark information bi to b n embedded therein are 
extracted from the image data, and then the processing is 
finished. 

If it is not confirmed for all the bits of k in step 
25 S4005 that the bit data concerned are embedded in the 

extracted pixel data, and if it is judged in step S4006 
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that any peak value has not yet been detected, the 
processing goes to step S4007. In step S4007, the detailed 
size/position matching unit 505 judges whether the set 
rotational angle reaches to the rough rotational angle 
determined in the rough size/position matching unit 504 + p* 
If it does not reach the rough rotational angle + p, the 
set rotational angle is increased by an incremental width 
(for example, 1 degree) which is held in the detailed 
incremental width holder 511 and is smaller than the 
incremental width held in the rough incremental width 
holder 509 (step S4008), and then the processing returns to 
step S4003. On the other hand, if it reaches the rough 
rotational angle + p, it is judged whether the set 
magnification reaches the rough magnification determined in 
the rough size/position matching unit 504 + a (step S4009). 
If it does not reach the rough magnification + a, the set 
magnification is increased by only an incremental width 
(for example, 1%) which is held in the detailed incremental 
width holder 511 and is smaller than the incremental width 
held in the rough incremental width holder 509 (step S4010) 
and then the processing returns to step S4002. 

On the other hand, if the set magnification reaches 
the rough magnification + a, it is judged that no digital 
watermark information is embedded in the image data 
concerned, and thus the processing is finished. 

When the magnification and the rotational angle to 
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specify the detailed size and rotational angle of the X-Y 
coordinate used to extract the pixel data having the 
digital watermark information bi to b n from the image data 
are determined in the detailed size/position matching unit 
5 505 through the flow of Fig. 10, the image restoring unit 
506 deforms the image data held in the information- inserted 
image holder 508 on the basis of the magnification and the 
rotational angle according to the magnification and the 
rotational angle thus determined, and restores the image 

10 data before the geometrical deformation is applied thereto. 
For example, assuming that the magnification thus 
determined is equal to 0.5 times and the rotational angle 
thus determined is equal to 45 degrees, the image data held 
in the information-inserted image holder 508 are deformed 

15 by a magnification of two times and a rotational angle of 

-45 degrees to restore the image data to the original image 
data before the geometrical deformation is applied. 

Subsequently, for each of the bits bi to b n 
constituting the digital watermark information, the 

20 watermark detector 507 extracts from the image data 

restored in the image restoring unit 506 pixel data located 
at predetermined positions 1 to m on the X-Y coordinate (X- 
Y coordinate which is not deformed) used to extract pixel 
data having the digital watermark information b x to b n 

25 embedded therein, calculates the differential value S-R 
between the sum S of the brightness values of the pixel 
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data thus extracted and the sum R of the brightness values 
of pixel data adjacent to the extracted pixel data, and 
then compares the differential value S-R thus calculated 
with a second threshold value T 2 which is held in the 
5 detailed threshold value holder 512 and whose absolute 

value is larger than the first threshold value T x , thereby 
judging the value of the bit data. Further, the watermark 
detector 507 holds the digital watermark information thus 
extracted into the detection information holder 513, This 

lo information is output through the input/output unit 502 and 
given to the operator. 

The above -described second embodiment has the same 
effect as the first embodiment. In addition, according to 
the second embodiment , the check of the embedding position 

is of the digital watermark information can be performed 

without applying any geometrical deformation to the image 
data itself, so that the memory capacity required for the 
processing and the load imposed on the process can be more 
greatly reduced as compared with the first embodiment. 

20 Further, according to the second embodiment, when the 

magnification and the rotational angle to specify the 
detailed size and rotational angle of the X-Y coordinate 
used to extract the pixel data having the digital watermark 
information bi to b n from the image data are determined in 

25 the detailed size/position matching unit 505, the image 
restoring unit 506 deforms the image data held in the 
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information- inserted image holder 508 on the basis of the 
magnification and the rotational angle according to the 
magnification and the rotational angle thus determined, and 
restores the image data before the geometrical deformation 
is applied. Thereafter, in the watermark detector 507, the 
digital watermark information is extracted from the 
original (non-deformed) image data thus restored. 

Usually, when the image data are scaled down, the 
size of the image data is reduced by removing any pixel 
data from the image data. Therefore, when the image data 
having the digital watermark information embedded therein 
is subjected to the scale-down processing, there is a 
probability that the pixel data having (a part of) the 
digital watermark information embedded therein are removed 
from the image data in the scale-down processing. In such 
a case, it may be considered that all the digital watermark 
information cannot be efficiently extracted from the image 
data concerned. 

On the other hand, in this embodiment, when the image 
data are scaled down, the image data are deformed by the 
magnification corresponding to the magnification to specify 
the detailed size of the X-Y coordinate determined in the 
detailed size/position matching unit 505 to scale up the 
image data concerned to the size before the geometrical 
deformation is applied. Usually, the scale -up of the image 
data is performed by interpolation. 
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In the first and second embodiments, it is assumed 
that the embedding of each of the bits b x to b n constituting 
the digital watermark information into the image data is 
performed by embedding each of the bits into each pixel 
5 data located at each of predetermined positions on a 

specific X-Y coordinate. However, in many cases, each of 
the bits is frequently embedded into pixel data of N * M 
located at predetermined positions 1 to m on a specific X-Y 
coordinate. In such a case, according to the second 

10 embodiment of the present invention, even when one of the 
pixel data of N * M in which bit data are embedded is lost 
during the scale- down process of the image data, the 
interpolation is performed on the basis of the remaining 
pixel data having the bit data embedded therein when the 

15 image data are scaled up, so that there is a high 

probability that the pixel data in which the bit data lost 
in the scale -down process are embedded could be restored. 
Therefore, according to the second embodiment, the 
detection precision of the bits bi to b n constituting the 

20 digital watermark: information can be enhanced. 

In the first and second embodiments, for each of 20 
bits out of the bits bi to b n constituting the digital 
watermark information, it is judged whether the bit data of 
the bit concerned is embedded in pixel data located at the 

25 predetermined positions 1 to m on the X-Y coordinate, 

thereby specifying the size and rotational angle of the 
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image data or the X-Y coordinate which are requested to 
detect the digital watermark information bi to b n . However, 
the present invention is not limited to this mode. 

For example, for any one of the bits h 1 to b n 
constituting the digital watermark information, it may be 
judged whether the bit data of the bit concerned is 
embedded in the pixel data located at the predetermined 
positions 1 to m on the X-Y coordinate, thereby specifying 
the size and rotational angle of the image data or the X-Y 
coordinate which are requested to detect the digital 
watermark information bi to b n . Alternatively, for each of 
the bits bi to b n constituting the digital watermark 
information, it may be judged whether the bit data of the 
bit concerned is embedded in pixel data located at the 
predetermined positions 1 to m on the X-Y coordinate, 
thereby specifying the size and rotational angle of the 
image data or the X-Y coordinate which are requested to 
detect the digital watermark information bi to b n . 

In the former case, if the first threshold value Ti 
to judge whether the bit data are embedded is more strictly 
settled, the check of the pixel data having the digital 
watermark information embedded therein could be more 
efficiently and quickly performed. For example, in a case 
where the first threshold value Ti is set so that each of 
the bits constituting the digital watermark information can 
be detected with an error rate of about 1CT 8 , if the number 
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n of bits constituting the digital watermark information is 
equal to 50, the probability that it would be erroneously 
judged that any one of the bits bi to b 50 can be detected is 
equal to 10~ 8 , and this value means that there is no 
5 practical problem. 

Further, in the latter case, if the first threshold 
value Ti used to judge whether bit data are embedded in 
pixel data is more moderately set , the check of the pixel 
data having the digital watermark information embedded 

10 therein can be more efficiently and quickly performed. For 
example, in a case where the first threshold value Ti is 
set so that each of the bits constituting the digital 
watermark information can be detected with an error rate of 
about 1CT 1 , if the number of bits constituting the digital 

15 watermark information is equal to 50, the probability that 
it would be erroneously judged that all the bits b L to b 5 o 
can be detected is equal to 10" 50 , and this means that there 
is no practical problem. 

In the first and second embodiments, the differential 

20 value between the sum R of the brightness values of plural 
pixel data located at predetermined positions on the X-Y 
coordinate and the sum R of pixel data adjacent to the 
plural pixel data (here, the sum R is used as a reference 
value to calculate the differential value) is calculated. 

25 However, the present invention is not limited to this 
reference value. For example, the sum R 1 of brightness 
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values of pixel data each of which is interpolatively 
determined on the basis of plural pixel data located in the 
neighborhood of each of the plural pixel data may be used 
as the reference value. In this case, the digital 
5 watermark information can be extracted with higher 
precision . 

Next , a third embodiment according to the present 
invention will be described. 

In the first and second embodiments, the second 

10 threshold value T 2 used for the judgment of the bits 
constituting the digital watermark information in the 
watermark detector 507 is set to be larger than the first 
threshold value Ti used for specifying the embedding 
positions of the bits h x to b n constituting the digital 

15 watermark information. Further, in the watermark detector 
507, the pixel data located at the embedding positions 1 to 
m specified for the respective bits bi-b n constituting the 
digital watermark information are extracted, the 
differential value S-R between the sum S of the brightness 

20 values of the pixel data and the sum R of the brightness 
values of the pixel data adjacent to the extracted pixel 
data is calculated, and then if S-R ^ T 2 , the bit concerned 
is judged as "1", if S-R ^ ~T 2 , the bit concerned is judged 
as "0", and if -T 2 < S-R < T 2 , it is judged that no bit is 

25 embedded in the extracted pixel data. 

Therefore, if the second threshold value T 2 is not 
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optimized to the image data from which the digital 
watermark information is to be extracted, the inequality: 
-T 2 < S-R < T 2 is satisfied although the bits b ± (l^i^n) 
constituting the digital watermark information are embedded 
5 in the predetermined positions 1 to m of the image data, so 
that it may be judged that no bit bi is embedded in the 
image data. That is, the extraction sensitivity of the 
bits bi to b n constituting the digital watermark information 
is lowered. 

10 Therefore, according to the present invention, in the 

watermark detector 507, the second threshold value T 2 used 
for the judgement of the bits bi to b n constituting the 
digital watermark information is set to zero, whereby each 
of the bits bi to b n constituting the digital watermark 

15 information embedded in the image data is set so as to be 
necessarily judged as "0" or "1". In connection with this 
setting, prior to the bit value judgment of each of the 
bits bi to b n constituting the digital watermark information 
embedded in the image data, the error rate of the bit value 

20 judgment of the bits b x to b n constituting the digital 

watermark information embedded in the image data when the 
second threshold value T 2 is set to zero is calculated. In 
this case, only when the error rate is equal to or less 
than a predetermined value, that is, the reliability of the 

25 bit value judgment is equal to or more than a predetermined 
value, the bit value judgment is carried out. 
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Next, the digital watermark information extracting 
device to which this embodiment is applied will be 
described. 

In the digital watermark information extracting 
5 device to which this embodiment is applied, only the 

function of the watermark detector 507 is different from 
that of the first and second embodiment in Fig. 3, except 
that the second threshold value T 2 held in the detailed 
threshold value holder 512 is equal to zero. The hardware 

10 configuration thereof is the same as shown in Fig. 4. 
Therefore, only the watermark detector 507 of this 
embodiment will be described. 

Fig. 11 is a functional diagram showing the watermark 
detector 507 used in the third embodiment of the present 

15 invention. As shown in Fig. 11, the watermark detector 507 
used in this embodiment has an error calculator 507a and a 
bit value judgment unit 507b. 

The error rate calculator 507a extracts from the 
image data restored in the image restoring unit 506 pixel 

20 data located at predetermined positions 1 to m on the X-Y 
coordinate for each of bits of h (for example, 20 bits of 
bi to b 2 o) out of the bits b L to b n constituting the digital 
watermark information, and then calculates the differential 
value S-R between the S of the brightness values of the 

25 pixel data thus extracted and the sum R of the brightness 
values of pixel data adjacent to the extracted pixel data. 
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The h differential values S-R calculated for the respective 
bits of h are classified into two subset on the basis of 
the second threshold value T 2 (= 0) serving as the boundary, 
that is, on the basis of the positive or negative value of 
5 each differential value S-R. Thereafter, for each of the 
two subset, a probability distribution curve of 
differential values S-R is determined on the basis of a 
statistic value such as the average value or dispersion 
value of the differential values S-R contained in the 

10 subset or a histogram distribution thereof. Thereafter, a 
bit value judgment error is calculated from at least one 
probability distribution curve of the positive and negative 
two subsets thus determined. 

Fig. 12A shows the probability distribution curve of 

15 the differential values S-R thus calculated. In this 

embodiment, the embedding positions at which the bits b x to 
b n constituting the digital watermark information are 
embedded in the image data are specified along the first 
and second embodiments, and thus the differential values S- 

20 R calculated for each of the bits of h (for example, 20 

bits of bi to b 20 ) out of the bits b x to b n constituting the 
digital watermark information is classified into positive 
and negative two subsets. Accordingly, the bit value 
judgment error rate can be calculated from the probability 

25 distribution curves of these positive and negative two 

subsets. For example, the probability that a bit which is 
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originally "1" is erroneously judged as "0" can be 
calculated as the rate of the negative area (an area 
(oblique-line portion) smaller than the threshold value T 2 
(0) ) in the probability distribution curve of the positive 
5 subset in Fig. 12A. Further, the probability that a bit 

which is originally "0" is erroneously judged as "1" can be 
calculated as the rate of the positive area (an area 
(painted portion) larger than the threshold value T 2 = 0 ) 
in the probability distribution curve of the negative 
10 subset. 

For reference, the probability distribution curve of 
the differential values S-R when no digital watermark 
information is embedded is shown in Fig. 12B. In this case, 
the probability distribution curve of the differential 

15 values S-R as shown in Fig. 12B becomes a distribution 
including 0 as a center point . 

When the bit value judgment error rate calculated in 
the error rate calculator 507a is below a predetermined 
value (the predetermined value is set according to the 

20 reliability requested to the digital watermark information 
to be extracted, and it is set to 10~ 3 , for example), for 
each of the bits b x to b n constituting the digital watermark 
information, the bit value judgment unit 507b extracts from 
the image data restored in the image restoring unit 506 

25 pixel data located at predetermined positions 1 to m on the 
X-Y coordinate used when the digital watermark information 
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is embedded, calculates the differential value S-R between 
the sum S of the brightness values of the extracted pixel 
data and the sum R of the brightness values of pixel data 
adjacent to the extracted pixel data, and then compares the 
differential value S-R thus calculated with the second 
threshold value T 2 (i.e., 0) held in the detailed threshold 
value holder 512, thereby judging the value of the bit data. 
Specifically, if S-R is positive, the bit concerned is 
judged as "1", and if S-R is negative, the bit concerned is 
judged as "0". 

Fig. 13 is a flowchart showing the operation of the 
watermark detector 507 used in the third embodiment of the 
present invention. 

This flow is started at the time when through the 
flow of Fig. 6 the magnification and the rotational angle 
to specify the detailed size and rotational angle of the 
image data are determined in the detailed size/position 
matching unit 505 and the image data held in the 
information-inserted image holder 508 are deformed by the 
magnification and the rotational angle thus determined to 
be restored to the image data in the image restoring unit 
506 before the geometrical deformation is applied thereto, 
or at the time when through the flow of Fig. 10 the 
magnification and the rotational angle to specify the 
detailed size and rotational angle of the X-Y coordinate 
used to extract from the image data the pixel data having 
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the digital watermark information bi to b n embedded therein 
are specified in the detailed size/position matching unit 
505, and the image data held in the information-inserted 
image holder 508 are deformed by the magnification and the 
5 rotational angle according to the magnification and the 
rotational angle thus determined to be restored to the 
image data before the geometrical deformation is applied 
thereto . 

First, for each of bits of h (for example, 20 bits of 

10 bi to b 2 o) out of the bits bi to b n constituting the digital 
watermark information, the error rate calculator 507a 
extracts pixel data located at predetermined positions 1 to 
m on an X-Y coordinate from the image data restored in the 
image restoring unit 506, and then calculates the 

15 differential value S-R between the sum S of the brightness 
values of the pixel data thus extracted and the sum R of 
the brightness values of pixel data adjacent to the 
extracted pixel data (step S5001). Subsequently, the 
differential values S-R of h thus calculated are classified 

20 into two subsets in accordance with the positive or 
negative sign thereof (step S5002). Thereafter, the 
average E and the dispersion V of the differential values 
S-R for each of the two subsets are calculated, and then 
the probability distribution curve of the differential 

25 values S-R for each of the two subsets is determined from 
the average E and the dispersion V thus calculated (step 
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S5003). 

Subsequently, the error rate calculator 507a 
calculates a bit value judgment error rate FP from the two 
probability distribution curves thus determined (step 
5 S5004). Specifically, the probability FP that a bit which 
is originally "1" is erroneously judged as "0" is 
calculated as the rate of a negative area (an oblique-line 
portion smaller than the threshold value T 2 = 0 ) in the 
probability distribution curve of the positive subset in 

10 Fig. 12A. Further, the probability FP that a bit which is 
originally "0" is erroneously judged as "1" is calculated 
as the rate of a positive area (a painted portion larger 
than the threshold value T 2 = 0) in the probability 
distribution curve of the negative subset in Fig. 12A. 

15 Subsequently, the error rate calculator 507a confirms 

that both the bit value judgment error rates FP thus 
calculated are equal to or less than a predetermined value 
(for example, 10' 3 ) (step S5005), and the processing goes to 
step S5006. If one of both the bit value judgment error 

20 rates FP is larger than the predetermined value (step 

S5005), it is judged that the bit value judgment cannot be 
performed with requested reliability , and thus the 
processing is finished. 

In step S5006, for each of the bits bi to b n 

25 constituting the digital watermark information, the bit 
value judgment unit 507b extracts from the image data 
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restored in the image restoring unit 506 pixel data located 
at predetermined positions 1 to m on the X-Y coordinate 
used when the digital watermark information is embedded, 
calculates the differential value S-R between the sum S of 
the brightness values of the extracted pixel data and the 
sum R of the brightness values of pixel data adjacent to 
the extracted pixel data, and then compares the 
differential value S-R with the second threshold value T 2 
(i.e., 0) held in the detailed threshold value holder 512, 
thereby judging the value of the bit data. Specifically, 
if the value of S-R is positive, the bit concerned is 
judged as " 1" , and if the value of S-R is negative, the bit 
concerned is judged as "0". Thereafter, the bit value 
judgment unit 507b outputs the bit values of the bits h x to 
b n constituting the digital watermark information (Step 
S5007) . 

According to the third embodiment of the present 
invention, the second threshold value T 2 used for the bit 
value judgment of the digital watermark information 
embedded in the image data is set to zero. Therefore, each 
of the bits bi to b n constituting the digital watermark 
information embedded in the image data is necessarily 
judged as "0" or "1", and thus the extraction sensitivity 
of the bits bi to b n constituting the digital watermark 
information embedded in the image data can be increased. 
Further, in this embodiment, prior to the bit value 



78 




judgement of each of the bits b x to b n constituting the 
digital watermark information embedded in the image data, 
the bit value judgment error rate of the bits bi to b n 
constituting the digital watermark information embedded in 
5 the image data when the second threshold value T 2 is set to 
0 is calculated, and only when the error rate is equal to 
or less than a predetermined value, that is, only when the 
reliability of the bit value judgment is equal to or more 
than a predetermined value, the bit value judgment is 

10 carried out. Therefore, the reliability of the bit value 
of the digital watermark information output from the bit 
value judgment unit 50 7b can be ensured. 

In the third embodiment, the bit value judgment error 
rate FP of the bits b x to b n constituting the digital 

15 watermark information embedded in the image data when the 
second threshold value T 2 is set to 0 is calculated in the 
error rate calculator 507a, and the bit value judgment of 
the bits bi to b n constituting the digital watermark 
information embedded in the image data is carried out in 

20 the bit value judgment unit 507b only when the error rate 

FP is equal to or less than a predetermined value. However, 
irrespective of the bit value judgment error rate FP 
calculated in the error rate calculator 507a, the bit value 
judgment is carried out in the bit value judgment unit 507b. 

25 That is, as shown in the flowchart of Fig. 14, the step 
S5005 may be deleted from the flowchart of Fig. 13. In 
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this case, in addition to the bit value judgement result in 
the bit value judgment unit 507b, the bit value judgment 
error rate FP (or the reliability of the bit value judgment 
result derived from the bit value judgment error rate FP) 
calculated in the error rate calculator 507a is output in 
step S5007. Through this processing, it can be grasped how 
degree the reliability of the bit value of the digital 
watermark information judged in the bit value judgment unit 
507b is. 

Further, according to the third embodiment, the 
second threshold value T 2 used for the bit value judgment 
of the digital watermark information embedded in the image 
data is set to 0 in the bit value judging unit 507b. 
However, the second threshold value T 2 may be set to a 
value other than 0. In this case, the error rate 
calculator 507a may calculate the bit value judgment error 
rate of the bits bi to b n constituting the digital watermark 
information embedded in the image data as described below. 

That is, for each of bits of h (for example, 20 bits 
of bi to b 20 ) out of the bits h x to b n constituting the 
digital watermark information, the pixel data located at 
predetermined positions 1 to m on the X-Y coordinate are 
extracted from the image data restored in the image 
restoring unit 506, and the differential value S-R between 
the sum S of the brightness values of the extracted pixel 
data and the sum R of the brightness values of pixel data 



80 



. -•> . • • • o 

adjacent to the extracted pixel data is calculated. 
Thereafter, the probability distribution curve of the 
differential S-R values is determined on the basis of the 
statistical value such as the average value and dispersion 
5 value of the differential values S-R of h calculated for 
the respective bits of h or a histogram distribution 
thereof, and then the bit value judgment error is 
calculated from the probability distribution curve thus 
determined. Fig. 15 shows the probability distribution 
10 curve of the differential values S-R thus determined. The 
bit value judgment error rate may be calculated as the rate 
of an area shown in black to the probability distribution 
curve . 

The error rate calculator 507a of the third 
15 embodiment may be applied to a case where it is merely 

judged whether the watermark information is embedded in the 
image data . 

The present invention is not limited to the above 
embodiments, and various modifications may be made without 
20 departing from the subject matter of the present invention. 
For example, according to each of the above 
embodiments, in the rough size/position matching unit 504 
and the detailed size/position matching unit 505, the 
geometrical deformation is applied to the image data held 
25 in the information-inserted image holder 508 or the X-Y 
coordinate for specifying the embedding position of bit 
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data constituting the digital watermark inf ormation . 
Thereafter, for each of any number of bits of the bits bi 
to b n constituting the digital watermark information, the 
pixel data located at the predetermined positions 1 to m on 
the X-Y coordinate are extracted from the image data, the 
differential value S-R between the sum S of the brightness 
values of the extracted pixel data and the sum R of the 
brightness values of the pixel data adjacent to the 
extracted pixel data is calculated, and then the absolute 
value of the differential value S-R is compared with the 
first threshold value Ti held in the rough threshold value, 
thereby judging whether the bit data are embedded in the 
extracted pixel data. 

However, the present invention is not limited to the 
above mode. The function of the error rate calculator 507a 
described in the third embodiment may be applied to the 
judgment of the embedding position of the bit data in the 
rough size/position matching unit 504 and the detailed 
size/position matching unit 505. 

That is, in the rough size/position matching unit 504, 
the image data held in the inf ormation -inserted image 
holder 508 or the X-Y coordinate are first reduced with a 
predetermined magnification. Thereafter, for each of any 
number of bits of the bits b x to b n constituting the digital 
watermark information, the pixel data located at the 
predetermined positions 1 to m on the X-Y coordinate are 
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extracted, and the differential value S-R between the sum S 
of the brightness values of the extracted pixel data and 
the sum R of the brightness values of the pixel data 
adjacent to the extracted pixel data is calculated. 
5 Subsequently, on the basis of the statistical values such 
as the average value and the dispersion value of the 
differential values S-R thus calculated for the respective 
bits of any number or the histogram thereof, the 
probability distribution curve of the differential values 

10 S-R is determined, and then the bit value judgment error 

rate is calculated from the probability distribution curve. 
Further, a series of processing of judging whether the bit 
value judgment error rate is below a predetermined value or 
not, thereby judging whether bit data are embedded in the 

15 extracted pixel data, is performed while rotating the image 
data concerned or the X-Y coordinate by every first 
incremental rotational angle held in the rough incremental 
width holder 509 within a predetermined range. If it is 
judged that no bit data are embedded, the same processing 

20 is carried out while the image data or the X-Y coordinate 
is scaled up by every first incremental magnification held 
in the rough incremental holder 509. This processing is 
repetitively carried out until it is confirmed that bit 
data are embedded (specifically, the image data or X-Y 

25 coordinate having the size and the rotational angle at 

which the bit value judgment error rate thus calculated is 
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below the predetermined value and minimum is detected) . 

y 

Likewise, in the detailed size/position matching unit 
505 , the image data held in the information-inserted image 
holder 508 are scaled down with a magnification which is 
lower by a predetermined value than the magnification of 
the image data or the X-Y coordinate when it is confirmed 
in the rough size/position matching unit 504 that the bit 
data are embedded. Thereafter, for each of any number of 
bits of the bits bi to b n constituting the digital watermark 
information, the pixel data located at the predetermined 
positions 1 to m on the X-Y coordinate are extracted, and 
the differential value S-R between the sum S of the 
brightness values of the extracted pixel data and the sum R 
of the brightness values of pixel data adjacent to the 
extracted pixel data is calculated. Subsequently, the 
probability distribution curve of the differential values 
S-R is determined on the basis of the statistical values 
such as the average value and the dispersion value of the 
differential S-R values calculated for the respective bits 
of any number or the histogram thereof, and then the bit 
value judgment error rate is calculated from the 
probability distribution curve. Thereafter, a series of 
processing of judging whether the bit value judgment error 
rate thus calculated is below a predetermined value , 
thereby judging whether bit data are embedded in the 
extracted pixel data, is carried out while the image data 
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is rotated by every second rotational angle (which is 
smaller than the first rotational angle and held in the 
detailed incremental width holder 511) within a 
predetermined range containing the rotational angle of the 
image data when it is confirmed in the rough size/position 
matching unit 505 that the bit data are embedded. 
Thereafter, if it is judged that no bit data are embedded, 
the same processing is carried out while the image data are 
scaled up by every second magnification which is held in 
the detailed incremental width holder 511 and smaller than 
the first magnification. This processing is repetitively 
carried out until it is confirmed that the bit data are 
embedded . 

In each of the above embodiments, the processing of 
applying the geometrical deformation to the image data or 
the X-Y coordinate used to specify the bit position of the 
digital watermark information embedded in the image data 
(the processing in the rough size/position matching unit 
504, the detailed size/position matching unit 505 and the 
image restoring unit 506), and the processing of judging 
and extracting the bit value of each bit of the digital 
watermark information embedded in the image data (the 
processing in the watermark detector 507) are carried on 
one device. However, the present invention is not limited 
to this embodiment. For example, the processing of 
specifying the bit position of the digital watermark 
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information embedded in the image data and the processing 
of judging and extracting the bit value of each bit of the 
digital watermark information embedded in the image data 
concerned may be carried out on different devices , 
respectively. 

Fig- 16 shows a modification in which the processing 
of specifying the bit position of the digital watermark 
information embedded in the image data and the processing 
of judging and extracting the bit value of each bit of the 
digital watermark information embedded in the image data in 
each of the above embodiments are carried out on different 
devices. In Fig. 16, the elements having the same 
functions as shown in Fig. 3 are represented by reference 
numerals . 

In Fig. 16, digital watermark information presence or 
absence judging devices 700i to 700 n serve to perform the 
processing of specifying the bit position of digital 
watermark information embedded in image data, and each 
device is designed to have such a structure that the 
watermark detector 507, the detailed threshold value holder 
512 and the detection information holder 513 are omitted 
from the digital watermark information extracting device 
shown in Fig. 3. The digital watermark information bit 
judgment device 800 serves to perform the processing of 
judging and extracting the bit value of each bit of the 
digital watermark information embedded in the image data, 



86 



and it is designed so as to have such a structure that the 
rough size/position matching unit 504, the detailed 
size/position matching unit 505 , the image restoring unit 
506, the rough incremental width holder 509, the detailed 
incremental width holder 511 and the rough threshold value 
holder 510 are removed from the digital watermark 
information extracting device shown in Fig. 3. The digital 
watermark information presence or absence judgment devices 
700x to 700 n and the digital watermark information bit 
judgment device 800 are mutually connected to each other 
through a network. 

Each of the digital watermark information presence or 
absence judging devices 700 x to 700 n specifies the embedding 
position of the digital watermark information for the image 
data held therein according to the flow shown in Figs. 5 
and 6 or Figs . 9 and 10 . The image data for which the 
embedding position is specified (that is, the image data 
for which the presence of the digital watermark information 
is judged) are restored to the original state by the image 
restoring unit 506, and then transmitted from the image 
restoring unit 506 through the input/output unit 502 and 
the network to the digital watermark information bit value 
judgment device 800. 

Upon receiving the image data from the digital 
watermark information presence or absence judgment devices 
700i to 700 n , the digital watermark information bit value 
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judgment device 800 performs the bit value judgment of the 
digital watermark information embedded in the image data, 
and transmits the judgment result through the input/output 
unit 502 and the network to the digital watermark 
information presence or absence judgment devices 700 x to 
700 n which are transmission destinations of the image data. 

The above configuration is suitable for the judgment 
of the watermark information of the image data supplied 
from plural Web servers connected to the Internet. In this 
case, each of the digital watermark information presence or 
absence judgment devices 700i to 700 n is built up on the Web 
server. A program for building up the digital watermark 
information presence or absence judgment devices on the Web 
server may be supplied in a so-called agent style in which 
the program is successively shifted onto plural information 
processors through the network, and executed on the 
information processor serving as each shift destination. 

Fig. 17 shows a system when the program for building 
up the digital watermark information presence or absence 
judgment device shown in Fig. 16 on the Web server is 
supplied in a so-called agent style. 

In Fig. 17, the digital watermark information bit 
value judgment device 800 has an agent program for building 
up the digital watermark information presence or absence 
judgment device shown in Fig. 16 on Web servers 900x to 900 n , 
and transmits the agent program onto the network 
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periodically or at the time when a predetermined event 
occurs . The agent program transmitted onto the network is 
shifted onto the Web servers 900i to 900 n in predetermined 
order. For example, it is first shifted onto the Web 
server 900i, and executed thereon to build up the digital 
watermark information presence or absence judgment device 
700!. Thereafter, the embedding position of the digital 
watermark information is carried out for the image data 
held in the Web server 900 x according to the flow of Figs. 
5 and 6 or Figs. 9 and 10. The image data for which the 
embedding position is specified (that is, the image data 
for which the presence of the digital watermark information 
is judged) are restored to the original state, and 
transmitted to the digital watermark information bit value 
judgment device 800 to wait until it receives the bit value 
judgment result of the digital watermark information 
embedded in the image data concerned. 

When the bit value judgment result is received from 
the digital watermark information bit value judgment device 
800 or when the embedding position is not specified and 
thus the absence of the digital watermark information is 
judged, the agent program is shifted through the network 
onto the next Web server. The agent program is 
successively shifted on the Web servers 900 r to 900 n to 
perform the above processing. 

As described above, according to the present 
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invention, the digital watermark information can be 
extracted from the geometrically- deformed image data 
without using any calibrating digital watermark. Further, 
even when the extraction sensitivity of the bits 
5 constituting the digital watermark information is increased, 
it can be grasped whether the bit value of the extracted 
digital watermark information can be relied on. 
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